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1. Introduction 


When modeling degradable computing systems by stochastic processes 
for the purpose of performance and reliability evaluation, the models 
employed are typically Markov processes (see [ 1 ] , for example) or 
models which can be analyzed in terms of imbedded Markov processes 
(semi "Markov processes, branching processes, etc.; see [2 ]). However, 
to ensure the validity of the Markov assumption, it is usually necessary 
to model the structure and behavior of the system at a low level, e.g., 
a level describing the system's structural resources (processing units, 
memory units, input buffers (queues), etc.). Performance and reliability 
measures, on the other hand, often quantify the system's behavior in 
terms of high level, user oriented variables (throughput, response 
time, operational status, etc.) which, if viewed as stochastic process- 
es, are seldom Markovian. In such cases, an essential part of the 
modeling effort is to establish a "connection” between the low and 
high levels, so as to resolve the probabilistic nature of the measure 
in question. 

Historically, in the context of reliability modeling, this con- 
nection has taken a form that lies at one of two extremes. At one 
extreme, system "success" is defined in terms of the underlying struc- 
tural resources (at least so many fault-free processors, at least so 
many fault-free memory units, etc.), in which case the connection 
between structure (available fault-free resources) and performance 
(success or failure) is immediate. At the other extreme, the object 
of the modeling effort is the connection, per se, and the resulting 
model is typically some form of "event-tree" or "fault-free" (see 
[ 3 ] , for example) . 
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More recently/ in efforts to deal simultaneously vith issues 
of performance and reliability/ the general nature of this connection 
has been formalized and is referred to as a "capability function" [ 4 ] 
of the system. In this setting/ a "total system" S, comprising a 
computing system and its computational environment/ is modeled at a 
low level by a stochastic process Xg (the "base model" of S) . Then/ 
relative to a high level variable Yg (the "performance" of S) / the 
capability function of S is a function Ys which translates state 
trajectories (sample paths) of the process Xg into corresponding 
values of the performance variable Yg. Knowing Xg and y^, it is 
possible (although not necessarily feasible) to solve for the proba- 
bility distribution function of Yg and, hence, determine the 
"performability" of S. 

In cases where the performance Yg is relatively far removed from 
the base model Xg, solution procedures can be facilitated by intro- 
ducing intermediate models at levels between Xg and Yg . One use of 
such a model hierarchy is a step-by-step formulation of the inverse 
of Yg, beginning at Yg and terminating at the base model Xg. if 
is discrete, the performability of S can then be solved by deter- 
mining the probabilities of certain trajectory' sets that correspond 
(under Y 3 ^) performance values of Yg. (See [ 4 ] for details 
regarding this method; also see [ 5 ] which uses this technique to 
evaluate the performability of the SIFT computer.) 

Another role that can be played by an intermediate model, and 
the one we explore in this report, is to represent the probabilistic 
nature of S at a level which is higher than the base model and thus 
"closer" to the performance variable. In particular, we consider a 
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class of intermediate models which are generally referred to as 
"functionals” of a Markov process (see [$] , for example). More 
precisely, a functional of a Markov process X is a stochastic process 
X (not necessarily Markovian) where, relative to a specified real- 
valued function f defined in the states of X, if X^»i then X^*f(i) for 
each time instant t in the utilization period. We first discuss (Section 
2) the conditions under which X is itself a Markov process, in which 
case X can be viewed as a "lumped” version of X. Since these conditions 
are quite severe, we go on to examine solution methods for non-Markovian 
functionals (Section 3) where, in particular, we develop a closed-form 
solution of performability for the case where performance is identified 
with the minimum value of a functional. 


-4 


2 . Functionals as Intermediate Models 

When describing system behavior in user oriented terms, it is 
possible, in many cases, to identify various operational "modes" for 
the system (including a failure mode) which result in different degrees 
of user satisfaction. Moreover, for a given mode of operation, the 
extent of user satisfaction can often be quantified as a (real number) 
"rate" at which that operation benefits (or penalizes) the user. 
Depending on the application, these rates can have a variety of inter- 
pretations relating to the system's productivity, responsiveness, etc. 
or, at a higher level, to such things as economic benefit, e.g., the 
"worth rate" (measured, say, in dollars/unit time) associated with a 
given mode of operation. 

Under the above conditions, a user-oriented model can be construc- 
ted in a rather natural fashion. As in our introductory remarks 
(and following the terminology and notation of [ 4 ] ) , let S denote 
the total system in question and suppose that we have already deter- 
mined a base model Xg and a capability function Yg (relative to some 
specified performance variable Yg) . Suppose further that the base 
model process Xg is defined relative to a continuous time interval 
T (the "utilization period"), that is, 

Xg = {X^lteT} (1 ) 

where the random variables X^ take values in a discrete (countable) 
state space Q. Thus, without loss of generality, the states of Xg 
will often be designated by positive integers, viz. 

Q = {1,2,3,...} 
or, in case Q is finite, 

Q “ {1,2, ...,n}. 


5 


Finally / we presume that at the base level# the system model is 
Matkovi»n with a tim«-invariant structure, that is, Xg is a 
(continuous-time) time-homogeneous Mar)cov process. (Since Q is 
discrete, some authors would refer to Xg as a Markov "chain"; we 
choose to maintain the use of the generic term "process".) 

Within this framework, let us now consider the situation discussed 
above where, at a higher level, one is able to identify various oper- 
ational modes for S, each having an associated operational rate. If, 
further, each state of the base model can be classified according to 
some mode of operation, then there is a naturally defined real-valued 
f unci’ ion 

f : 0 a ( 2 ) 

where, for each ieQ, f(i) is the operational rate associated with the 
mode containing i. Moreover, if we let Q denote the range of 
f (i.e., Q»{f (i) I ip.Q) ) and, for each variable X^ of Xg (see (1 )), we 
let 

\ “ f (X^) , ( 3 ) 

it follows that 

Xg = {X^jteT} ( 4 ) 

is a stochastic process with state space Q (referred to generally as 
a "functional" [ 6 ] of the underlying Markov process) . 

Except in the special case where f is 1-1 (i.e., different states 
correspond to diffferent modes of operation) , the derived process X,, 

O 

represents a simpler, higher level view of the system S. However, to 
qualify Xg as an "intermediate" model, we must also require that Xg 
be compatible with the performance variable Yg to the extent that Yg 
can be solved in terms of Xg. More precisely, letting k denote the 


translation of trajectories of Xg to trajectories of Xg (i.e,, 
k(u)»u where u(t)»f (u (t) ) , for all teT) / there must exist a capability 
function 7g Xg such that 

Yg-K » Yg ( 5 ) 

(where • denotes functional composition, first applying k ) . Although 
the above condition appears somewhat formidable, it says simply that 
the higher level model Xg must remain detailed enough to permit solution 
of the system's performability . Moreover, this condition can be 
typically satisfied in practice if the definition of performance 
(i.e., Yg) is taken into account when identifying the various modes 
of operation and assigning rates to these modes. 

If f , as defined in ( 2 ) , satisfies condition ( 5 ) then we 
refer to f as an operational structure ot S and, since states inherit 
the rates assigned to modes, the value f(i) is referred to as the 
operational rate of j (or, when context permits, simply the "rate of 
i"). Likewise, the corresponding functional Xg is referred to as an 
operational model of S or, alternatively, a model of S at the 
operational level . 

In reliability modeling where, at the operational 
level, a system is typically viewed as either "operating" or "not 
operating", the concept of an operational structure reduces to the 
familiar notion of a "structure function" [3]. Technically, a 
function f: Q-> 31 is a structure function if Q has binary coordinates, 
i.e., Q={0,1}^, and f( i) is 1 or 0 according as S is operating or 
not operating in state i . More recently, operational structures have 
been employed (at least implicitly) in the context of performance- 
reliability modeling where the operational rates are referred to as 
computational "capacities" [ 7 ] # [ 8 ] * Although capacity (which typically 
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, refers to the maximum rate at which a computer can "supply" computations) 
is a legitimate interpretation of "operational rate", it should be 
emphasized that, in general, such rates can represent an interaction of 
supply (by the computer) and demand (from the environment) ; this follows 
from the fact that, as generally conceived, a state i of the base model 
represents a particular status of both the computer and its environment; 
hence, both supply and demand can be accounted for when translating i, 
via f, to its corresponding operational rate f(i). 

In various special forms, then, the concept of an operational 
structure is no stranger to performance and reliability modeling. On 
the other hand, the general nature of the associated "functional" Xg, 
how it relates to the base model, how it can be exploited in solution 
procedures, etc., appear to be subjects that deserve further investi- 
gation. 

To begin, let us suppose that S is modeled by (Xg,Yg) and f :Q->- ir 
is the operational structure of S. Then, to the extent that it is 
feasible, we would like to determine the probabilistic nature of the 
operational model, that is, the functional (see [6],( 9]) 

Xg = {f (X^) |teT} 

of the Markov process Xg. The first questions which arise 
in this regard are whether Xg is, itself, a Markov process and, 
if so, whether it is time-homogeneous. Note that, since these questions 
do not involve the actual values of f, Xg may be regarded here as a 
"lumped" [10] version of Xg, where states i and j are in the same lump 
if and only if f(i)=f(j). (In other words, lumps coincide with the 
operational "modes" of S.) Moreover, these questions are obviously 
independent of our interpretations of Xg and Xg and hence, in the 


developmfint that follows# we can drop the specific reference to S. 

Let us suppose# then# that X is a time-homogeneous Markov process 
with state space Q and# given a function f:Q'i* a# let X denote the 
corresponding functional or# what is the same# the lumped process 
induced by f. If f is 1-1 then X is obviously both Markovian and 
time-homogeneous since# in this case# the lumping is trivial. If f 
is properly a many-to-one function the answers are no longer obvious 
and# indeed# the questions need further clarification. 

In the latter regard# let us restrict our attention to finite-state 
processes X which are "regular" in the sense that their transition 
probabilities are uniquely determined by a "generator matrix" or# 
equivalently# a "state-transtticn-rate" diagram. More precisely# 
let X be a Markov process with state space Q=^{1 # 2 , . . . #n> and# for if^j# 
let X. . denote the transition rate from state i to state j. Then the 
generator matrix of X is the nxn matrix 


where 


a,. 


it 

13 


l ^ik 

kj^i ^ ■ 


i?^j# 

if i=»j . 


( 6 ) 


If# further# we let P(t) denote the "transition function" of X (we 
presume here that tei’O#"))# i.e.# 


P(t) = [Pij(t)] 

where 


P. . it) = Pr[X^.=j 1 Xq=1] # 


then A uniquely determines P(t) by the well known equation 




P(t) - 

H«nc« A (or P (t) ) together with an initial distribution 
P « IPi Pi ■ Pr[XQ-il 

are enough to completely specify the process X. 

In the above setting f our original inquiry thus reduces to the 
question: 

Ql) Given p and f, is X Markovian? 

In many applications, however, one wants the freedom to alter the initial 
distribution p without losing the Markov property. In this case we are 
asking: 

Q2) Given A and f, is X Markovian for arbitrary p? 

Finally, we can raise our sights even higher and ask: 

Q3) Given A and f, is X Markovian for arbitrary P and, more- 
over, is the transition function of X independent of P? 

Adopting the terminology of [10] (which investigates the discrete-time 
versions of Ql and Q3 ), if the answer to Ql is "yes" then the 
process X^, specified by A and p is "weakly lumpable" with respect to 

i.1 

f. A "yes" answer to Q2 is stronger but, generally, these Markov 
processes will not be time-homogeneous. If the answer to Q3 is "yes" 
then, for all initial distributions p, the Markov processes X have the 
same transition function and, by the homogeneity of X, it follows that 
this function is invariant under time shifts, i.e., the processes are 
time-homogeneous. In this case to say that the processes X specified by A 
are "strongly lumpable" with respect to f. 

Addressing first the question of weak lumpability (Ql) , if X is 
to be a Markov process, we must insure it has the "memoryless" property, 
that is, any sequence of past observations of X provides the same 
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information as th® last of those observations. To formalize this 

t 

requirement, if 0 :<tj^<t 2 <' * '<tj^ is a sequence of observation times 
and qj^eQ"f(Q) is the state of observed at time t^, for each under 
lying state je{l,...,n}, let 

Mj (tj^,. . .,tj^;qj^, . . .>q,^) - 

then the Ixn matrix 

M ( 1 2 / • • • » t ^ ' * * * * ^ j ( ? ) 1 


is the probability distribution of the states of x at time tj^, as 
conditioned by these observations of x. in particular, since 
X^ »q^, it follows that M j ( ; ) is nonzero only if f{j)*qj^» where 
{Mj ( ; )If(j)“qj^) gives the probability distribution of states inside 
the lump f"^ (qj^) . 

So as to translate distributions of X back up into distributions 

of X, let us suppose further that X has m states (m<n) and, relative 

th 

to some specified ordering of the lumps, let denote the Z lump, 
i.e., the collection of sets 

{Qjj^ll < ^ < m} 


is the partiticn of Q induced by f. Accordingly, if 7 t=* is 
a probability distribution over the states of X, we let it denote the 
corresponding distribution that is, 

? - ^2 • • • 


where 

?. = I 7t/ (l<j<m). 

^ isQj ^ 

In terms of the above notation, weak lumability can then be character- 
ized as follows. 
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Theorem 1 ; Let X be a time-homogeneous Markov process with transition 
function P an'^- fixed initial state probability distribution. Let 
X be a functional of X and, for s^T, define 
A g ■ { M ( t , • • • , t , • • • , ) | • 

Then X is a Markov process if and only if, for all s, teT such that 

s<t and for all 'ir,Tr,*eA , ?■?' implies ttP ( t'-s ) =7r'* P "( t-sT. 

s 

The proof of Theorem 1 is essentially a generalized form of the 
argument used to prove its discrete-time analog (see [10], pp. 133-134, 
Theorem 6.4.1). To illustrate its application, let us suppose that 
the system in question is a multicomputer comprised of three identical 
computer modules. Suppose further that modules fail independently and 
that each fails permanently with a constant failure rate X. Then we can 
take the base model X to be the Markov process depicted by the state- 
transition-rate diagram of Figure 1 . 



Figure 1 


As for operational rates, let us assume they are normalized so that, 
at full capacity, the rate is 1 and with the loss of one or two modules, 
the rate is .5; loss of a third module results in total failure. 
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Accordingly# the operational structure in this case is the function 


1 

1 

2 

3 

4 


f(i) 

1 

.5 

.5 

0 


and hence the functional X takes values in the state set Q»{l/.5/0}. 
On taking the inverse of f, these states correspond as follows to 
lumps of Q: 

{ 1 } 

• 5 {2,3} 

0 { 4 } . 


If we now examine the probabilistic nature of X, we find that the 
conditional probability Pr [X. *0 | X =.5] depends on the time that X 
enters state .5 from state 1 if the latter event is possible (i.e., 

if the probability of initially being in state 1 is non-zero) . Thus, 

for example, if X is initially in state 1 with probability 1, i.e., 
P=[l 0 0 0] is the initial state probability distribution, then we 
have such a dependence (on the past history of X) and therefore X is 
not a Markov process. On the other hand, let us suppose the initial 
distribution is P=[0 0 1 0], which is not a likely choice from a 
functional point of view but it serves to illustrate the role of p. 

In this case A (as defined in the statement of Theorem 1) is the 

5 

same for any time s in T, i.e., it is the set 

A ^ = { [0 0 1 0 ] , [0 0 0 1 ] }. 

s 

Accordingly, the conditions of Theorem 1 are vacuously satisfied and, 
therefore, X is a Markov process for this choice of p. Moreover, it 
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should be obvious that K, in this case^ is time-homog<^neous . Other 
distributions > such as p>[0 1 0 0] can be shown to result in Markov 
processes which are not time -homogeneous. 

Turning our attention now to the second question (see Q2 above) , 
the answer# in a slightly more specialized form# can be found in the 
existing literature (see [11]# p. 1113-1114# Theorem 4). Stating the 
desired form of this result in terms of the notation defined above# 
we have; 


Theorem 2 ; Let X be a time-homogeneous Markov process with generator 
matrix A=[a^j] and let X be a functional of X determined by f. Then 
X is a Markov process# whatever the initial distribution of X# if and 
only if for each q€Q taken separately either 


(i) For all i#j€Q such that f(i)?^q and f(j)=q# 


or 


(ii) For all r€Q such that rj^q# the sum 

1 ^i j 

f(j)=r 

is the same for all i€Q such that f(i)=q. 


Although the conditions of Theorem 2 guarantee that X is a Markov 
process relative to any initial distribution p for X, it should be 
noted that the specific nature of X (as specified by its transition 
function) will generally depend on p. Moreover# the process X need 
not be time-homogeneous. 

To illustrate Theorem 2 and the above observations# let us again 
consider the Markov process X having the state-transition-rate diagram 
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glven by Figure 1. Then, by (6), the generator matrix of X is the 
4x4 matrix 

-3X 3X 0 0 

0 - 2 >. 2 \ 0 

A 

0 0 - X X 

0 0 0 0 

Suppose, however, that the operational sturcfure in this case is one 
that corresponds to triplication with voting (TMR) , i.e., the function 


Then Q={1,0} and, applying Theorem 2, we see that state 1 (i.e., lump 
{1,2}) satisfies condition (i) and state 0 (i.e., lump {3,4}) satisfies 
condition (ii) . Hence, the functional X is a Markov process. To 
determine the probabilistic nature of X, let us rename state 0 (in Q) 
as state 2 (permitting the use of standard matrix notation) and let 
P(s,t) denote the transition function of X, i.e., 

P(s,t) = [p^j(s,t)] (s<t) 

where 

(s,t) = Pr[X^=j |Xg=i] . 

Then, relative to an initial distribution p= [Pj^ P2 P3 P^] for X, if 
we let 



P1+P2 




d 


-15- 


it can be shown that the matrix P(s,t) 

— 2 X ( t— S ) / 

F,,(s,t) . S 

a+ 2 d(l-e '^®)) 

■ 1 — p^j^(S/t) ! 

P2j^(s,t) « 0, 


has the following entries ; 


(7) 


p22(s,t) » 1. 


/ 


Prom the above equations, we see that the transition function P(s,t) 
depends on d and, hence, on the initial distribution p“[pj^ ?2 P3 P4] • 
Moreover, we observe that X is time-homogeneous (i.e., the values of 
P(s,t) depend only on the time difference t-s) just in case d=0 . In 
other words, by the definition of d, X is time-homogeneous if and only 
if Pj_“0, i.e., there is a zero probability that the underlying process 
X is initially in state 1 (all three modules fault-free) . However, 
with our interpretation of X as a TMR model, this special case is 
pathological and hence, in cases of practical interest, X will not be 
time -homogeneous . 

Finally, turning to the question of strong lumpability (see Q3 
above) , the answer can be characterized by removing condition (i) of 
Theorem 2 and modifying the proof to accommodate this change. More 
precisely, we have 


Theorem 3 ; Let X be a time-homogeneous Markov process with generator 
matrix A=[a^j] and let X be a functional of X determined by f. Then 
X is a Markov process, whatever the initial distribution p of X and 
with a transition function that is independent of p, if and only if 
for each q€Q the following condition is satisfied: 




To Illustrate Theorem 3^ suppose X is specified by the generator 
matrix 

3\ \ \ A 0 0 0 

0 -2A 0 0 A A 0 

0 0 -2A 0 A 0 A 

0 0 0 -2A 0 A A (9) 

0 0 0 0 0 0 0 

0 0 0 0 0 0 0 

0 0 0 0 0 0 0 

and f is the function 


( 10 ) 


Testing condition (8) for states 1 and 2 in Q, we see that it holds 
trivially since these states correspond to singleton lumps. As for 
state 3 (corresponding to lump {3,4}), with respect to states 1,2^0 
the sums are zero for both i=3 and i=4; with respect to state 4^Q 
the sum is 2A for both i=3 and i=4. Thus condition (8) holds for 
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state 3. Finally^ (8) is likewise satisfied for state 4CQ and we 
conclude that X is a Markov process with a transition function that 
is independent of p. 

In general, if X is strongly lumpable (as characterized by Theorem 
3) it is easily shown that X must inherit the time-homogeneity of X. 

In other words, a strongly lumped process will always be time- 
homogeneous and, accordingly, it can be specified by a constant gen- 
erator matrix. More precisely, if Q has m states and we rename 
them (if not already so named) with the integers from 1 to m, the 
generator matrix A“[a ] of X can be constructed directly from A, 

SI* 

where entry a (q^r) is given by the invariant sum of condition (8) 
for any i such that f(i)»q, (The diagonal entries a are then 
determined by the condition that rows must sum to zero.) Thus, for 
the example just con«icl«jred (see (9) and (10)), the generator matrix 
of X is the 4x4 matrix 


-3^ X 2X 0 


A = 


0 

0 


-2a 0 

0 -2X 


2X 

2X 


0 0 0 0 . 


Reviewing the results of this section, it is clear that a strongly 
lumped process is the most desirable type of operational model. On 
the other hand, by Theorem 3, it is evident that such models require 
a relatively restricted "match" between the probabilistic nature of 
the base model (as specified by A) and the operational structure f. 

The conditions of Theorem 2 are somewhat weaker although, when 
satisfied, the transition rates of the resulting Markov functional 
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are generally time-vary ing and dependent on the initial distribution 
of the underlying process. Of significance hare is the fact that even 
without strong lumpability one can obtain operational models that are 
Markovian and admit to feasible, closed-form euialytic solutions (see 
Equations (7), for example). What must be employed, in this case, are 
solution techniques for arbitrary (discrete-state) Markov processes, 
as opposed to more special (emd much more familiar) techniques which 
apply only to time-homogeneous Markov processes. 

Finally, regarding weak lumpability (Theorem 1) , the requirement 
here is even less restrictive. However, depending on the nature of 
A, p and f, it may be very difficult to decide whether the condition 
of Theorem 1 is satisfied. Moreover, we currently know of no general 
means of solving such models without resorting to detailed computa- 
tions at the base model level. The utility of wecdc lumpability is 
also curtailed by the fact that the initial state distribution of the 
base model is fixed. This may be satisfactory in certain applications 
but, in many cases, one wishes to examine the influence of different 
initial distribv^tions . In such cases, one must derive a solution for 
each of the designated distributions provided, of course, that each 
admits to weak lumpability. 

Theorems 1-3 thus provide formal support of what we, and others 
in the field, have observed through experience: at higher, more 

user-oriented levels of abstraction, it is difficult to maintain a 
Markovian representation of system behavior. As a consequence, we 
should seek means for accommodating operational models (functionals) 
that are not Markovian. The latter task is less formidable than it 
might appear if we bear in mind that, when evaluating a system S, an 
operational model Xg plays an intermediate role in support of a 
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deslgnated performance variable Y,.. Thus, our knowledge of can be 
restricted to that required to solve the probability distribution 

I 

of Ygr i«e., the performability of S. The latter observation serves 
as the guiding principle for the work described in the following 
section. 
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3. Solution Using Functionals 

In this section r we consider the solution of performability 
with respect to a generally defined performance variable. This 
variable is defined in terms of an arbitrary operational model 
which, as discussed in the previous section, is generally non- 
Markovian. However, by relating this variable to the underlying 
Markov process, it is shown that system performabilities can still 
be solved using traditional Markov process methods. 

3.1 Performance Variable 

The performance variable we consider is motivated by needs 
which arise when performance is "recoverable** at the operational 
level. More precisely, let us say that an operational method • 

X ■ {X_ Is e [0,t]} is recoverable if there is at least one opera- 
tional rate q and time u,v (0£u<v£t) such that 
Pr[X^ > q 1 - q] >0. 

In other words, it is possible for the operational rate to recover 
from q to a value higher than q. If this is the case then, clearly, 
the operational rate at the end of utilization (i.e., the value 
will generally not convey the "worst case" rate experienced 
during [0,t;] . (On the other hand, if X is not recoverable, one 
can easily show that X^ i£ the worst case rate.) 

Motivated by the above considerations, let us suppose that 
X » {X^ 1 0 < s < t} 

is a finite-state Markov process and, relative to an operational 
structure f, 

X = {f(Xg) I 0 < s < t} 

is the operational model (functional). Then a performance variable Y^, 
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Indlcating the minimum operational rate during [0,t], can be 
defined on as follows: 

- min {f (Xg) I 0 < s < t} . (11) 

Figure 2 depicts the value of Y^ for a representative sample path 
of the functional 3T. If X is not recoverable, then Y^ is simply 
the operational rate at time t. In this case, solving perform- 
ability (relative to Y^) is tantament to solving the transition 
function of X. On the other hand, if X is recoverable, the 
solution process becomes more involved, as we discuss in the 
section that follows. 


3.2 Performability Solution 

As defined above, we note first that Y^ is a discrete perfor- 
mance variable since the base model X has a finite number of 
states and, hence, there is a finite number of operational rates. 
Therefore the performability Pg of S (see [4], definition la) is 
simply the probability distribution of Y^, i.e., 

Pg (q) « Pr lY^ » q] . (12) 

Accordingly, if we are able to solve the conditional probabilities 
giq(t) = Pr[Y^ a q 1 Xq » i] 

where ieQ , qeQ , 0 £ t < “, then is obtained by the well- 

Icnown formula 

Pg(q) “ I • 

® ieQ 

Note that, in the case where t » 0, the minimum operational rate 
is just the operational rate associated with the initial state; 
in short 


g^gfo) =■ 


0 


if f(i) = q 
otherwise . 


(13) 
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To r«lat« th« conditional probabilitiaa to th« gantrator 

matrix A of the underlying Markovian base model X (see (6)), we 
first introduce the random variable 

■ min {s I s >0/ X^ i and Xq ■ i} 
called the first exit time from state i (also called the first 
sojourn time in i) . Then, using the "strong Markov property" at 
P^ (a detailed discussion of the strong Markov property can be 
found in [6], pp. 168-177), we are able to represent 9ig(t) in 
terms of recurrence relations involving the coefficients a^j 
of the generator matrix. 


Theorem 4 ; Let X be a Markov process with an operational structure 
f:Q-+» then, fo’' each ieQ , qeQ and 0 < t < «, 


/f(j)>q 




-a 


e 


gjq(t-a)da 

if f(i) > q 


^iq 


(t) 




I l a 

r>q f(j)>r •'0 




V. 


if f (i) * q 
otherwise. 


(14) 


Proof; We first write 

giq(t) Pr[Y^ » q, > t | Xg * i] + Pr[Y^ = q, 1 t 1 Xg « i]. 

(.15) 

Since f(i) < q implies 5j_q(t) = 0, we need to consider (15) only for 
two cases: f(i) > q and f(i) » q. 
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Case 1: f(l) > q< 

If the first state transition from state i occurs after t 
(i.e. > t) , then 

■ min {f (Xg)| 0 £ s < t> ■ f (i) q. 

It follows that 

Prly^ » qf > t I Xq « i] ■ 0 . (16) 

On the other hand, if the event {Pj^ £ t} occurs, then i must 
be the case that the first state transition occurs at time P,* to 
some state j and the minimum operational rate occurs at a time 
between pj^ and t. Then the strong Markov property at pj^ gives 
PrlYt - q I - j , Xq - i] - PrtY^.p^- q | X^ - j J • 

Hence, applying the above equation, 


Pr £Y^ 

“ q» Pi < 1 1 Xg - i] 



rt 




-fo 

Pr(Y^ ■ q# Pi ■ a|Xg « 

ildcx 


-r 

Jq 


1 PrlX^ - j, Pi - - i 

] da 


Now, since 

Pr(y^,_^» ql Xq * j] - gjg(t-<t) 

and 

Pr[X(;j - j, » i] - (1 - <Sij)a.je , 

the above equality becomes 

Pr[Y^ * q, p^ < t I Xg =« i] 

/ t -a . . a 

(1 - ^iJa. .e g.„(t-a)da. (17) 

Accordingly, replacing the right side of (15) by (16) and (17) 
and noticing that g. (t-a) = 0 when f(j) < q, we have 

J tl 
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^iq 


(t) 


*'0 


-a., a 

(1 - g^g(t-a)da 


Casa 2t £(1) > q. 

Since the sojourn times o£ a Markov process are exponentially 
distributed, we have 

Pr[Y^ - q,Pi > t|x^ i] 

■ Pr[Y, - q I p. > t^X ■ i] Pr[p. > t| X « i] 

^ 0 0 
-a, .t -a.it 

« 1 . e » e . (18) 

If the event {p^ _< t} occurs, then it must be the case that the 
first state transition occurs at time to state j and 
min {f(X ) I p. < s < t} ■ r for some r > q. Accordingly, applying 
the strong Markov property at p^^ and repeating the arguments for 
case 1, we have 

Pr[Y^ - q, p^ < t|XQ = i] 


I I r 

r>q jeQ *'0 


(1 - fiij)a. .e 


-a-ia 


g^-(t-a)da . 
J* 


(19) 


Replacing the right side of (15) by (18) and (19) , we finally 


have, for the case that f(i) = q, 

-a..t rt 

gi„(t) . e “ + I I / U - 

r>q f(j)>r •'0 ^ 


-a . . a 

j)a^j6 gjj.(t-a)da . 


To solve equation (14) , we first note that the integrals on 
the rights side can be expressed as the convolutions of the functions 

-afit 

gjj.(t) and W^j(t) = (1 - <Sij)a^je , i.e.. 


W. .* g. (t) 

”13 Jq 13 


r 

Jo 


W.^(a) gjj,(t-a)da . 


Then, since W..* g. (t) = * W..(t), the derivative of the 

1 J J 4- J J. X J 


convolution W. .* g.^(t) can be expressed as 

13 0^ 
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d -a.i(t-a) 


gjy (a) da] 




-a. . (t-a) 


IX 


gjy ( a)da 


+ (1 - 


<-*ii> '5jr* - «ij!»ij9jr«=> 


- ‘”ij* 9jr(t)l + (1 - 

Thus, taking derivative term by term and letting f(i) > 
g^„(t) - _l_ ^tWij* gjg(t)l 


dt ^iq 


= (-a,,) [ 


f (j) >q 


I 


w,.* g.„(t)] 


f(j)>q 

+ ^ [(1 - ^i-i)a..g. (t)] 

f(j)>q 


=a..g. (t) + ^ a..g. (t) 

f(j)>q 

j?^r 


^ a..g (t). 
f(j)>q 


q^ 


( 20 ) 
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Similar ly, when f(i) ■ q, 

-a . . t 


- (-aii)e 


XX 


+ I I i(W( .*g. (t)J 
r>q f(j)>r 


(-a,.)e + (-a,,) [I I W, . * g.^(t)l 


‘ii' 


‘ii 


r^q f(j)^r 


X3 -3r 


+ I I [(1 - 

^><i f(j)>r 




-aiit -a. .t 

(-a,.)e + (-aii)[gig(t) - e ] 


+ I I t(l - 

r^q f(j)>r 




(-aii)g,„(t) + ^ I tu - 6(Ja,.g. (t)) 

r>q,f(j)>r 

I ^ a. .g . (t) . 
r>q f(j)>r 


( 21 ) 


Accordingly, combining (20) and (21) , we obtain the following 
expression for the derivative of g£q(t) 

Corollary ; Let X be a Markov process with operational structure 
f:Q S then, for all ieQ, qeQ and 0 £ t < “>, 


^ ^ a . .g . (t) 

f(j)>a 


& 5lq‘*=> ' 


^ ^ a. ,g. (t) 

r>q f(j)>r 


if f(i) > q 

if f (i) = q (22) 


0 otherwise . 

The equation (22) is, in fact, a system of linear differential 
equations with n*m variables gi_(t) where isQ and qeQ. Hence, by 
solving for g. (t) in terms of the coefficients a. . and time t, 

1 ^ i J 



-28- 


the probability distribution of the random variable can be 
expressed as, for each geQ, 


Pr[Y, 


q] « ^ gi„(t) pr[Xo 
ieQ 


i] . 


3 . 3 Taboo Probability Functions 

An alternative approach to derive expressions for the prob- 
ability distribution of the random variable Y^ is to use the notion 
of "transition probability with taboo states" defined as 


jjPij(t) » PrfXg^H, 0 < s < t; X^ - j 


il 


(23) 


where i/jeQ, HCQ and t>0. In words, „p. .(t) is the probability, 

— — H ID 

starting from state i, of entering the state j at time t under 
the restriction that none of the states in the set H is entered 
during the period [0,t]. The set H is called the taboo set and 
jjPj^j(t) is called the transition probability from i to j in time 
t under the taboo set H. 

The analytic and probabilistic properties of taboo probability 
functions have been studied extensively and a detailed account 
is contained in [ 6 ] . (Note that the taboo transition probability 
defined above is the simplified fom described in [ 6 ] on page 
191.) To represent „P; <(t) in terms of transition rates of the 

H ID 

underlying Markov process, one can simply solve the transition 
function of the transformed Markov process obtained from the 
original underlying process by making states in H absorbing state 
(i.e., by deleting all the transitions from each state in H to 
other states in the state transition diagram of the original process) . 
More rigorously, following arguments similar to the proofs of 


-29- 


Theorem 4 and its corollary, we can establish the validity of the 
above transformation method by the following Kolmogorov's 
differential equation: 

Theorem 5 : Let X ■ {x^| teT} be a continuous time finite state 

.Markov process then, for all i,jeQ and t^O, 

I ®ik H^kj 

’ I ^ 24 ) 

' 0 othervise. 

To establish the relationship between the random variable 
and the taboo probabilities, we note that the complemented 
probability distribution function of can be expressed as 

^ q] 

= Pr[min {f (X ) ] 0 •< s < t} > q] 

» Pr[f(X^) > q, 0 < s < t] 

= Prlx^/! {k } f(k) < q> , 0 < s < t] . 

That is, Pr[Y^ ^ q] can be regarded as the taboo probability in 
time t under the taboo set {k | f(k) < q} . Hence if we let the 
generator matrix of the transformed process be a nxn dimensional 
matrix 

fq - (25) 

such that for all i,, j in Q, 

a^^j if ie {k | f (k) ^ q} 

0 otherwise, 

then by Theorem 5, for all i,j£Q and t^O, 

^ PrtY^ i q, = j I Jio = il = PrtY^ i q- X^ = j I Xj = X) 

(26) 
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Solving the above system of differential equations, we obtain 

r t 

PrfY^ > q] - P(0) e ^ iLq (27) 

where p(0) is the initial probability distribution of the underlying 
process and is a n x 1 matrix 


iq' 

such that 


tc,l 


(28) 


if f(i) > q, 
otherwise. 


Finally, since 


Pr[Y 


^ * q] a Pr[Y^ > q] - Pr[Y^ > q + 1] 


the probability distribution of the ramdom variable Y^ can be 


expressed as, for all qeQ, 


Pr[Y, 


q] 


(29) 


P(0) - p(0) 


where p(0) is the initial probability distribution of the under- 
lying Markov process X. 


3.4 Conditional Expected Operational Rate 

In contrast with the above approach of regarding the perfor- 
mance of a system to be the minimum operational rate experienced 
by the system during [0,t], the performance of the system can also 
be taken to be the "expected" operational rate of the system during 
the period. For instance , when the operational rates of a system 
can be associated with the rates of information processed in the 
unit time, then the expected operational rate can often be inter- 
preted as expected throughput rate, expected capacity rate, expected 
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production rate, etc. The performance variable can be used to 
characterize the overall performance of both non-degradable and 
degradable computers (see [ 2 ] and [ 8 ], for example) . However, 
in order to analyze the performance of a degradable computer in 
detail, we found it is useful to decompose the expected operational 
rate into components involving different operational modes of the 
system. 

More precisely, if we denote the average operational rate of 
a system by the random variable 


6 


t 



f (Xg)ds 


(30) 


where [0,t] is the utilization period of the system, then the 
expected operational rate of the system can be decomposed according 
to the following well-known formula: 


E[6. ] = E[6. I Y. = q] Pr[Y^ = q] (31) 

^ qeQ t r t 

where Y^ is given by (11) . In other words, the effect on the system 

performance (relative to E[5^]) of an operational mode having an 

associated operational rate q can be quantified by taking the 

product of the conditional expectation E[6^| Y^ = q] and the 

probability of occurance of the operational mode Pr [Y^ = q] . 

To solve the conditional expectations E[6^ I Y^ = q] , let 

us write P^ to represent the conditional probability given = i 

and write E. [6. I Y. = q] instead of E[6. I Y. = q, X. = i] . Then, 

1 t t t t 0 

by expanding the conditional expectations, we have, for all qcQ, 

E[6^ q] 

= ^ E. [6 I Y = q] Pr[X. = i i Y = q]. (32) 

ig.Q X o o u r 



Moreovc^r,'for all qeQ, 

Eii«t '’‘t * 


” / > a|Y^ « q]da 


da 


/■* 

" Jq • 'll 

Pi[Yt > q] /■" 

■ . q] 1 ^ “• I ’'t i 

Pil^t i 'J+^1 /“ 

- “^h7=-qT Jo “1^ i 

Pi(Xt>ql , PJTrti^+U 

' q] ' h^h\^t i - - p. ' [Y, - ' ql ^ ■5*11 <33) 

Since ^i given by (27) 

and (29), we only need to solve for > q] and E^[6^|Y^ _> q+1] 

Now, because is a linear operator, for all qcQ, 

i '31 

’k i'31''" 

* t ' P,t4^"^ ' l !jL C - 3, V, > q]ds j. <34) 

To evaluate the integration, note that 
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■ P^[f (X ) > q foe all s <a < tjXg - j; > q 

for all 0 < a < 3] Pj [X^ ■ j; f(X ) > q 
for all 0 _< a £ 3] , 

Hence, by Markov properties, 

Pl[J<3 - j, >q] 

- PitXg • j, Yg > q] PjtY^.g > q]. (35) 

To simplify the notations, we observe that ^ <3]and 

Pj^ [Xg * j, Yg > q] are the taboo probabilities under the taboo 
set {k[f(k) < q}. Thus, if we let 

qPj^j(t) * taboo transition probability from i to j in time t 
under {k|f(k) < q} 


and 




Di(t) » ^ ' 

^ jeQ ^ 


then by combining (34) and (35) 


EitS^lY^ i q) 


Vl^> jeQ 




where (t) is the convolution of qDj(t) and 

by (33), 


Also 


Ei[«^lY^ . q] 


' t P^lY^ • ql^3Q *<j’fq°jVij‘''” 


■ t Pj^lY^ - qj 'q+l”j*q+l'’ij“'’'‘ 

Finally, by (33) and (36) , the conditional expected operational 
rate of a given value of can be expressed as 
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E(«tl*|. - q) 

•- '>i«» 


where p(o) ■ [Pj^iO),. . .Pj^(O)] is the initial probability distri- 
bution vector of the underlying Markov process X. 


3.5 An Example 

The example considered here is essentially a Markov model 
of a TMR system where the simplex system has failure rate X 
(see Figure 3) . It is assumed that the system has coverge 
factor c as well as capability of software error recovery. In 
Figure 3, each state of the process is denoted by two numbers 
separated by a slash; i/q. The integer i represents the number 
of operational modules; a prime is appended (i') if the state 
denotes a software error recovery state. The number q, specifies 
a relative worth of the state, i.e., q is the operational rate 
of the state i. The transition rates from each state are noted 
on the state diagram. If the utilization period is T = [0,t], 
then the system performance is given by 

Y. ■ min (f(X ) lO £ s < t} . 

By examining the state transition graph, it follows 
immediately that the generator matrix is 


A 


r -(3X+10"^) 


0 

10 

0 


3 


3XC 

-2X 

0 

0 


10 

0 


-3 


-( 10 ^+ 10 ^) 


3X(l-c) - 
2X 
102 
■ 0 


0 
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If we let 


r 



(3X+i0”^) 

0 

0 

0 


3Xc 

-2X 

0 

0 



3X(l-c) - 
2X 
0 
0 


r 


0.5 


(3X+10“^) 

0 

10 ^ 

0 


3Xc 10"^ 3X(l-c)“ 

-2X 0 2X 

0 -( 10 ^+ 10 ^) 10 ^ 

0 0 0 - 


and Tq * A, then by solving equation (24) the taboo transition 
probability functions are given by 


^P(t) » [ 3 ^p^j(t)l 

fe”0*0025t ^g-0.001t_g,-0.0025tj q q . 

e-O.OOlt 0 0 

0 0 0 

0 0 0 J . 

0 1 
0 
0 

0 - 

Vi/ he re 

» 0.9999991735 e~° * . 0000008265 q-HOO • 000909 1 

C 2 =« -2.538498242(e"°*°°^^^°^^-e“°‘°°^^) 
c » 0.0000009092(e“°’ 0015909t_^ 1100 . 000909 tj 

C 4 - 0.9090915(e-°-°°15909t_^-1100.000909tj 

Cg = -2.307727772(e"°*°°^^^°^^-e“°'°°^^) 

Cg => 0.0000008265 e'° * . 9999991735 . 


0 

0 

0 


0.5 




r C, 


ID 

C„ C. 

0 


'2 ''3 

-O.OOlt 


L 0 


0 
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and 

P 

0 

(t) * 

m 

°1 

P(t) a e^^I 
°2 

°3 

!• <= 1 + 02 + 03 ) 


0 

^-O.OOlt 

0 

, ^-O.OOlt 
1 -e 

m 

®4 

°5 


1 -(C 4 +C 5 +Cg) 


[0 

0 

0 

1 


where i» 1,2 ,..,, 6 are the same as in q gP(t). 

To determine the probability distribution of the random 
variable Y^, notice that equation (29) can be rewritten as 
Pr[Y^ - q] - p( 0 ) qP(t) - p( 0 ) q+iP(t) 

Assuming that the system initially has all three modules operational, 
i . e . , 

p( 0 ) - [ 1 , 0 , 0 , 0 ] , 

then, by ( 12 ) , the performability of the system relative to the 
performance variable Y^ can be expressed as 

Pg(l) - Pr[Y^ = 1] 
a (l“10"^)e”°*‘^°^^+ ^Q-7g-0.0025t 

Pg(0.5) a Pr[Y^ a 0.5] 

a -1.538498159 g"® * + 1.538498342 

,n“7 ^-0.0025t 
- lu e 

Pg(0) a Pr[Y^ a 0] 

a 1 + 1.538498159 e"0-0015909t _ 2.58498242 
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In Figura 4 tho performability of the lyttem is repreeented by 
three curves i I, II and III. Curve I is the probability that the 
system will operate at operational level 1 throughout the utili- 
zation period. The probability is equal to 1 at time 0 and 
gradually diminishes to 0 as the length of T goes to infiuity, 
curve II is the probability that the system suffered performance 
degradation during the utilization period while remaining operational 
throughtout the period. As shown in the figure, the probability 
of degraded performance goes from 0 to some positive probability 
and decreases to 0 again when t increases. This is due to the fact 
that state 1 is an absorbing state, thus, the system will eventually 
and up in failure state. Finally, we note that curve III is the 
familiar S-shape function for system failure probability. 

To compute the conditional expected throughput rate of the 
performance variable Y, we also assun\e that p(0) - [1,0, 0,0], 

Then, 


“ 1] 

* 1]' Jq tl°j*1^3j ^ 


'tl*t 

Fl>rn 




t PrtY^ » i] l-l 3 1*^33"" " 1“2 1^32 

+ (1-1( 
t Pr[Y^ » i] 


io“\ e-Q-°Q^^n (i-io-^)t e-Q-QQ^^ 


» 1 . 


Similarly, carrying out the computations, we have 
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t Pr[Y^"-'T.Tr jgg ^0.5°j”o.5P3j^^^ ^ 

“ t PrtY^ - 6.rr jeQ ti°j*iP3j^^^ J 


t PrlY^-- 5 -3T (1-538498342 t e“0*001" 


- 1.S38497523 t + 0 . 0017755848 e*®'®®^®®®®*= 


- 0.0017755848 e-®-®®!’= - lo''^ e-®-®®^®<=) 


and 


E[6^1y^ « 0] 


t PrlY^ » 6J 


[-964.0617977 (x-e“° * 


+ 2538.498242 


+ 1.538497523 t e 


-0.0015909t 


- 2.538498242 t e 


-O.OOlt 


- 0.0017755848 e 


-0.0015909t 


+ 0.0017755848 ]. 


Accordingly, if we assume that the utilization period of the system 
is [0,t] where t = 10 hours, then the performability and the 
corresponding conditional expected throughput rate are tabulated 
in Table 1. 
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